Spoke to James C. about ingestion service.
Expenses.
Replied to a few messages.
Checked over Rucio metadata deletion PR, contacted Cedric.
Checked STFC STORM ND is up and running (it was).
Expenses for CERN.
Implemented one-off orphaned metadata deletion script:
Script to do this baked into image: 130.246.213.80:5000/rucio-orphaned-metadata-delete-cj
DELETION CASCADE added to rucio-ivoa-integration FKEY between rucio.dids and rucio.obscore to propagate deletion in rucio.dids into rucio.obscore (https://gitlab.com/ska-telescope/src/ska-rucio-ivoa-integration/-/commit/330c5c8612ae42e107225523617781c39bd727ae)
Can be built from src-docker-registry (/home/rbarnsley/rucio-orphaned-metadata-delete-cj).
Currently down as a cronjob on srcnet-workload-1 cluster running every 15m. Takes ~3s for 10k rows of metadata.
Won't commit this to e.g. rucio-task-manager as it will hopefully be unnecessary soon...
got a bit sidetracked with a message from stfc saying our grafana instance had multiple vulnerabilities - had to upgrade but also took opportunity to add in persistence to dashboards (on my todo for a while).
enabled STFC_STORM Rucio storage to allow SKA IAM issued tokens.
read up a bit on the PR related to metadata deletion and prodded some people.
started tying bits together to make a script to remove orphaned metadata
Sick leave.
PI22 planning.
Some architectural C4 documentation: https://miro.com/app/board/uXjVNlHwNbI=/
Thinking about RSE mounting locally: https://miro.com/app/board/uXjVNjJAlis=/